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INTRODUCTION 


The  Computer  Assisted  Rehabilitation  Environment  (CAREN;  Motek  Medical  BV,  Amsterdam, 
The  Netherlands;  Figure  1)  is  an  immersive  virtual  environment  and  motion  analysis  laboratory 
designed  for  interactive  rehabilitation  and  research  of  human  performance  in  a  controlled  and 
repeatable  environment.  The  Department  of  Defense  uses  the  CAREN  system  for  clinical 


rehabilitation  and  research  at  four  locations:  Naval  Health  Research  Center  (NHRC),  Walter 
Reed  National  Military  Medical  Center,  Brooke  Army  Medical  Center,  and  the  National  Intrepid 
Center  of  Excellence.  At  NHRC,  the  CAREN  is  used  to  conduct  research  for  the  advancement  of 
treatment  and  rehabilitation  practices  in  the  CAREN  and  other  interactive  environments.  NHRC 
creates  and  tests  accelerated  rehabilitation  programs,  and  conducts  physical  and  cognitive 
performance  testing  under  virtual  conditions  relevant  to  the  warfighter. 


The  CAREN  requires  control  software  in  order  to  manipulate  and  monitor  the  hardware 
components,  activate  events,  record  information,  and  create  virtual  scenarios.  The  CAREN  D- 
Flow  control  software  (Motek  Medical)  allows  the  operator  to  create,  modify,  and  operate  virtual 
scenarios.  It  incorporates  different  modules  from  which  to  manipulate  and  monitor  the  hardware 
components,  activate  events,  and  record  information.  The  ideal  driving  simulator  for  NHRC 
would  include  a  variety  of  easily  modified  road  courses,  and  it  would  have  the  ability  to  collect 
data  for  research  purposes,  simulate  realistic  automobile  movements  using  the  motion  base 
platform,  and  integrate  an  eye-tracking  system.  While  the  D-Flow  software  is  capable  of 
controlling  the  system  and  creating  driving  scenarios,  it  does  not  contain  a  variety  of  easily 
modified  road  courses,  has  no  module  to  simulate  realistic  automobile  movements  during 
driving,  and  does  not  allow  for  eye-tracking  capabilities. 
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It  was  determined  that  the  driving  simulator  software  would  need  to  run  on  a  separate  computer 
network,  rather  than  that  of  the  D-Flow  software,  using  a  Phidget  (Phidgets  Inc.,  Calgary, 
Canada)  to  bring  analog  signals  to  the  D-Flow  software  for  platform  motion  control.  Pixelwarp 
Evo  software  (Florida  Music  Technologies  Inc.,  USA)  would  be  required  to  warp  and  blend  the 
video  for  the  CAREN’ s  180  degree  curved  screen.  In  order  to  satisfy  all  the  requirements  for  an 
NHRC  driving  simulator,  STISIM  Drive  software  (Systems  Technology,  Inc.,  Hawthorne,  CA) 


Figure  2.  NHRC  custom-designed  driving  simulator. 


was  chosen  as  the  control  software  for  the  driving  simulator.  This  software  is  specifically 
designed  for  driving  simulation  research  and  has  been  used  for  this  purpose  by  universities, 
government  agencies,  medical  facilities,  training  centers,  and  corporations.  STISIM  software  is 
also  “open  software,”  meaning  it  is  customizable,  allowing  for  integration  of  hardware  like  eye¬ 
tracking  systems.  The  faceLAB  5  eye-tracking  system  (Seeing  Machines,  Tucson,  AZ)  was 
selected  as  the  eye-tracking  platform  for  the  driving  simulator.  This  software  was  also  paired 
with  EyeWorks  software  (EyeTracking,  Inc.,  Solana  Beach,  CA),  which  allows  for  advanced 
design,  collection,  and  analysis  of  eye-tracking  data.  These  systems  work  in  combination  with 
the  STISIM  Drive  software  to  allow  for  seamless  data  collection  when  synced  with  Network 
Time  Protocol  (NTP)  software  (http://www.ntp.org/).  The  driving  simulator  cab  was  custom 
designed  and  built  in  house  at  NHRC  using  realistic  braking  and  steering  components.  The 
Trackstar  6000  GT  system  package  (Extreme  Competition  Controls,  Inc.  [ECCI],  USA)  was 
integrated  into  the  driving  cab  for  the  simulated  steering,  accelerating,  and  braking.  The  driving 
cab  itself  is  built  from  metal  tubing  and  designed  to  bolt  safely  onto  the  motion  platform  frame. 
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The  purpose  of  this  paper  is  to  report  the  methods  for  designing  and  integrating  this  driving 
simulator  into  the  NHRC  CAREN  system. 


METHODS 

Pixelwarp  Evo  Software 

Pixelwarp  EVO  is  a  software  program  that  deals  with  geometric  correction  and  edge  blending  of 
full-screen  real-time  gaming  applications.  The  software  takes  a  projected  display  and 
manipulates  control  points  in  order  to  align  the  image  on  the  screen  (Figure  4).  With  the 


Pixelwarp  software  and  a  Matrox  TripleHead2Go  multi-display  adapter  (Matrox  Graphics  Inc., 
Quebec,  Canada),  the  driving  simulator  video  can  be  split  into  three  outputs,  one  for  each 
projector,  then  warped  and  blended  seamlessly  over  the  CAREN’s  180-degree  curved  screen  at  a 
resolution  up  to  5760  x  1080.  This  video  is  connected  to  the  three  CAREN  projectors  via  the 
DVI  inputs  (Figure  5). 
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STISIM  Drive  Software 

STISIM  Drive  is  a  programmable  and  fiilly  interactive  virtual  reality  driving  simulator 
engineered  to  take  advantage  of  cutting-edge  computer  technology.  It  has  more  than  80  ready-to- 
run  driving  scenarios  that  present  diverse  driving  situations,  customizable  roadway 
environments,  and  an  extensive  library  of  roadway  objects.  The  system  also  allows  for  user- 
definable  data  collection. 

STISIM  Drive  has  an  Advanced  Vehicle  Dynamics  Module  (VDANL  Drive).  This  module  gives 
six  analog  output  signals  that  can  control  the  six-degrees-of-freedom  motion  platform  in  the 
CAREN  system  in  order  to  simulate  real  automobile  movements  during  driving.  This  is  achieved 
by  installing  in  the  driving  simulator  computer  a  PCIM-DDA06/16  6-channel,  16-bit  analog 
output  board  with  24  digital  I/O  (Measurement  Computing  Corporation  [MCC],  Norton,  MA), 
which  can  control  swaying,  heaving,  surging,  pitching,  yawing,  and  rolling  on  the  CAREN 
motion  platform. 
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A  significant  amount  of  hardware  is  required  to  bring  this  signal  to  the  D-Flow  computer.  A  37- 
pin  shielded  eable  (MCC  model  C37FFS-5)  is  eonnected  to  the  PC1M-DDA06/16  card  then  to  a 
37-pin  universal  screw  terminal  board  (MCC  model  CIO-MINI37).  The  serew  terminal  board  is 
then  wired  to  the  analog  inputs  in  the  model  1018  PhidgetInterfaceKit  (Phidgets  Inc.,  Calgary, 
Canada)  I/O  board.  Once  this  is  completed,  the  PhidgetInterfaeeKit  USB  cable  is  connected  to 
the  CAREN  eomputer  in  which  the  D-Flow  software  is  installed  (Figure  6).  A  simple  application 
is  then  ereated  in  the  D-Flow  software  conneeting  the  analog  signals  from  the  STISIM  Drive 
software  to  the  inputs  of  the  motion  platform  using  expressions  to  adjust  the  analog  signal  ranges 
to  eoineide  with  that  of  the  platform  ehannel  input  ranges  (Figure  7).  When  a  driving  simulation 
is  loaded,  the  STISIM  zeroes  the  analog  outputs,  simulating  that  the  platform  is  in  a  neutral 
position.  Upon  starting  the  simulated  drive,  the  platform  is  plaeed  in  the  neutral  position  then 
manually  engaged  in  D-Flow,  enabling  STISIM  Drive  to  eontrol  the  platform  for  simulated 
automobile  movement. 

The  STISIM  Drive  software  is  also  eapable  of  stereo-quality  sound.  To  integrate  this  audio  into 
the  CAREN  system,  a  fiber  optie  Toslink  eable  is  eonnected  from  the  driving  simulator  computer 
to  the  CAREN  audio  system. 
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Figure  6.  Driving  simulator  analog  signal  flow  diagram. 
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Figure  7.  D-Flow  driving  simulator  motion  control  application. 


I  ° 

0 

jh 

□ 

|I2 

□ 

|I3 

□ 

|I4 

□ 

|l5 

□ 

{I6 

□ 

CAREN  Driving  Simulation  8 


faceLAB  5  System  and  EyeWorks  Software 

The  faceLAB  5  eye- tracking  system  (Figure  8)  was  chosen  as  the  hardware/software  package  to 
collect  eye-tracking  data.  This  system  can  use  either  one  or  two  eye-tracking  cameras  to  collect 
data.  Each  eye-tracking  camera  requires  its  own  computer  for  real-time  data  collection.  An  IR 
emitter  is  used  in  conjuction  with  this  system  to  allow  for  eye  tracking  in  low  light  conditions. 
This  system  has  the  ability  to  accurately  capture  an  abundance  of  data,  including  head  and  eye 
positions,  gaze  position,  eyelid  and  lip  behavior,  and  many  other  head  and  facial  features. 

The  EyeWorks  software  is  an  add-on  software  package  that  is  used  with  the  faceLAB  5  eye¬ 
tracking  platform.  This  sofware  increases  the  data  collection  capablities  and  is  fully  customizable 
for  the  driving  simulator  system.  In  our  system,  EyeWorks  software  works  with  two  webcams 
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Figure  8.  faceLAB  5  system  and  EyeWorks  webcams. 
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and  two  faceLAB  5  stereoheads  in  order  to  obtain  eye-traeking  data  for  ~120  degrees  of  the 
screen  (Figure  8).  If  the  full  range  of  the  180  degree  screen  is  of  interest,  then  an  additional 
stereohead  would  be  required.  All  stereoheads  are  linked  together  by  using  the  Link  function  in 
EyeWorks.  All  webcams  and  stereoheads  are  calibrated  with  the  software  and  take  video  of  the 
1 80-degree  curved  screen  during  testing.  This  video  shows  eye-tracking  data  overlaid  onto  the 
driving  simulator  onscreen  video. 

Driving  Simulator  Cab 

The  NHRC  driving  simulator  cab  (Figure  9)  is  designed  using  automobile  seat  height  and 
distance-to-pedal  measurments  to  resemble  that  of  an  acutal  automobile.  The  frame  is  constucted 
from  black-powder-coated  steel  tubing.  The  high-performance  racing  seat  has  an  adjustable  slide 
mount  bracket  and  a  five-point  safety  harness.  The  ECCI  Trackstar  6000  GT  system  package  for 
steering,  braking,  and  acceleration  is  an  all-steel  construction  with  a  black-powder  coat  for 
durability.  The  pedal  unit  and  seat  position  are  adjustable  to  allow  for  various  driver  heights.  The 
ECCI  Trackstar  6000  GT  steering  is  fully  ball-bearing  suspended  and  free  from  friction.  The 
fluid  damped  steering  system  allows  force  and  velocity  of  wheel  movement  to  respond  at  a 
minute  level.  The  damping  effect  does  not  limit  subtle  corrections  of  steering  line,  but  it  does 
increase  proportionately  with  velocity  of  wheel  movement.  Quick,  extreme  movements  are 
resisted,  while  slow  and  subtle  movements  are  not.  The  result  is  realistic  simulated  wheel 
movement  stabilization.  The  steering  wheel  also  has  paddle  shifters  and  multiple  buttons  that  can 
be  programmed  to  provide  the  driver  with  additional  tasks  while  driving.  The  ECCI  package  also 
uses  a  next  generation  pressured  mapped  brake  pedal  or  PMB-II,  which  provides  pedal  operation 
with  the  true  feel  of  an  automobile  brake.  The  ECCI  Trackstar  6000  GT  interfaces  with  the 
driving  simulator  computer  using  a  standard  USB  cable  and  is  fully  compatible  with  the  STISIM 
Drive  software.  The  driving  cab  is  bolted  directly  to  the  platform  frame  of  the  CAREN  using 
preexisting  handrail  mounts. 

Driving  Simulator  and  Eye-Tracking  System  Data  Syncing 

The  driving  simulator  and  eye-tracking  system  require  a  private  network  for  communication  and 
data  syncing.  The  driving  simulator/eye-tracking  network  uses  an  off-the-shelf  network  switch, 
and  each  computer  in  the  system  has  its  own  network  card  dedicated  specifically  for  network 
communication.  Each  computer  is  assigned  a  static  IP  and  all  have  identical  subnet  masks.  Static 
IP  addresses  are  required  for  the  NTP  software  to  function  properly.  This  software  requires  a 
host  computer  in  order  to  sync  all  the  remaining  clocks  in  the  network.  This  host  computer  is 
identified  in  the  software  via  an  IP  address,  thus  it  must  remain  static.  In  this  network,  the 
driving  simulator  computer  is  used  as  the  host  while  the  eye  tracking  and  faceLAB  5  computers 
are  set  as  client  computers.  Having  the  correct  time  and  date  on  the  host  computer  is  not  essential 
since  all  the  client  computers  are  synced  to  that  time  for  data  collection  purposes.  The  NTP 
software  will  sync  all  the  client  computers  to  any  date  and  time  on  the  host  computer,  though 
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having  a  correct  date  and  time  is  recommended  since  this  may  be  an  important  aspeet  of  a 
researeh  question  and  will  also  help  reduee  the  risk  of  eonfusing  data  sets  after  testing. 

This  driving  simulator/eye-traeking  network  has  a  total  of  four  eomputers  hardwired  to  the 
network  switeh:  a  driving  simulator  computer,  an  eye-tracking  computer,  and  two  faceLAB  5 
eomputers  (one  for  each  eye-tracking  camera).  These  computers  all  colleet  data  during  research 
studies,  thus  it  is  essential  the  computer  times  are  synced  for  data  processing.  The  eye-traeking 
eomputer  and  faeeLAB  5  computers  also  use  this  network  for  communieation  in  the  software 
during  calibration  and  testing. 
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CAREN  HANDRAIL  MOUNT  DRIVING  SIMULATOR  CLAMP  MOUNT 


DRIVING  SIMULATOR  MOUNT  DRIVING  SIMULATOR 

WITH  MOUNTING  BOLT  THREADED  MOUNT 


DRIVING  SIMULATOR  SECURED  ON  MOTION  PLATFORM 


Figure  9.  Driving  simulator  cab. 
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Safety 

The  driving  simulator  cab  is  installed  on  a  platform  that  can  produce  sudden  movements.  It  is 
essential  that  the  cab  is  installed  securely  using  all  the  required  mounting  hardware.  Also,  the 
safety  harness  must  be  properly  fastened  any  time  the  platform  is  engaged  and  someone  is 
driving  the  simulator. 

RESULTS 

STSIM  software  package 

The  STSIM  software  provides  a  number  of  automated  outcomes  that  are  generated  as  .txt  fdes. 
Figure  10  provides  a  list  of  these  outcomes.  Summary  measures  offer  an  overview  of  the  total 
number  of  mistakes  that  occurred  during  the  scenario,  while  a  case-by-case  breakdown  of  each 
event  is  provided  for  a  more  detailed  examination  of  each  individual  mistake.  Rules  identifying 
mistakes  (e.g.,  cutoff  points  for  speeding  exceedances  or  tickets)  can  be  easily  modified  in  the 
program. 


Driver  mistakes: 


Total  number  of  off  road  accidents  =  0 

Total  number  of  collisions  =  0 

Total  number  of  pedestrians  hit  =  0 

Total  number  of  speed  exceedances  =  15 

Total  number  of  speeding  tickets  =  0 

Total  number  of  traffic  light  tickets  =  0 

Total  number  of  stop  signs  missed  =  0 

Total  number  of  centerline  crossings  =  0 

Total  number  of  road  edge  excursions  =  0 

Total  number  of  stops  at  traffic  lights  =  0 

Total  number  of  correct  DA  responses  =  0 

Total  number  of  incorrect  DA  responses  =  0 

Total  number  of  DAs  with  no  response  =  0 

Total  run  length  (Drive  t,  x,  Total  t)  =  531.72  40500  531.72 

Total  number  of  illegal  turns  =  0 

Total  number  of  low  speed  warnings  =  0 

Total  number  of  high  speed  warnings  =  0 

over  speed  limit  (%  Time,  %  Distance)  =  25.74  29.33 

out  of  lane  (%  Time,  %  Distance)  =  0.00  0.00 


individual  mistakes  (Time,  Distance,  Elapsed  distance  or  object  number.  Elapsed  time.  Maximum  value,  speed  limit/centerline): 


speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 
speed  exceedance 


92.74  6259.57  1279.20 

115.33  8253.72  2032.62 

148.88  11181.39  0.98 

156.06  11573.43  328.08 

182.97  13685.85  480.14 

217.11  16630.63  203.36 

229.19  17681.90  872.69 

246.72  19228.40  4020.19 

303.29  24306.96  157.23 

340.66  27203.67  657.39 

360.42  28368.80  84.67 

376.14  29638.45  801.13 

394.38  31245.92  639.80 

427.06  34084.60  317.43 

487.31  37958.83  1.96 


14.40  89.14  88.00 

22.05  94.74  88.00 

0.02  58.80  58.67 

5.02  74.32  58.67 

5.37  90.57  88.00 

2.30  88.71  88.00 

9.75  90.41  88.00 

44.41  93.99  88.00 

1.78  88.30  88.00 

10.66  62.92  58.67 

1.37  65.08  58.67 

8.93  91.09  88.00 

7.20  89.82  88.00 

3.60  88.31  88.00 

0.03  58.67  58.67 


Figure  10.  Example  of  STSIM  automated  output. 

Summary  measures  are  ealeulated  automatieally.  In  this  example,  the  driver  exeeeded  the  speed 
limit  15  times.  Eaeh  speeding  mistake  is  listed,  along  with  information  indieating  the  time  and 
distanee  from  the  beginning  of  the  seenario. 
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faceLAB  5  and  EyeWorks  software  packages 

The  faceLAB  5  package  provides  a  detailed  analysis  of  eye  movements  and  eye  closures  that 
occur  during  a  recording  session,  which  may  help  evaluate  driving  performance  issues  (e.g., 
fatigue).  The  program  generates  data  in  both  faceLAB  5  (.fll)  fdes  and  .txt  fdes.  The  following  is 
a  detailed  list  of  all  outcome  measures  provided;  note  that  these  data  must  be  further  processed 
using  another  program  (e.g.,  MATLAB,  Excel): 

1 .  Head  tracking  -  translation  and  rotation  of  head 

2.  Eye  tracking 

a.  left  and  right  eye  closures 

b.  Percentage  of  Eye  Closure  (PERCLOS)  (can  adjust  closure  threshold  and  time 
duration  window) 

c.  left  and  right  eye  pupil  diameters 

d.  eye  blinks  (frequency  and  duration) 

3.  Gaze  tracking 

a.  left  and  right  eye  yaw,  pitch,  and  “gaze  quality”  (scale  of  0-3) 

b.  vergence  distance 

The  EyeWorks  program  provides  real-time  information  on  the  direction  of  the  driver’s  point  of 
gaze  during  the  scenario  (Figure  11).  Retrospectively,  the  researcher  can  pair  data  generated 
from  EyeWorks  with  automated  STISIM  program  analyses  to  examine  relationships  between 
point  of  gaze/attention  and  driving  performance.  Additionally,  the  EyeWorks  program  provides 
detailed  analyses  on  visual  behavior  and  viewing  patterns  for  regions  of  interest. 
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CONCLUSION 

The  driving  simulator  and  eye-tracking  systems  integrated  into  the  CAREN  allow  for  the 
creation  of  repeatable  scenarios  with  generated  data  results  from  the  software  platforms.  These 
added  abilities  increase  the  research  and  rehabilitation  effectiveness  of  the  NHRC  CAREN.  With 
increased  effectiveness  comes  the  improved  ability  to  research  methods  of  rehabilitation  for  our 
service  men  and  women. 
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